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Overview 


Description  Page 

1.0  Introduction . 1 


The  Crew  Technology  Division  of  Armstrong  Laboratory  is  devel¬ 
oping  an  insert  for  the  MBU-20/P  aircrew  oxygen  mask.  The  insert 
is  placed  inside  the  mask  to  enhance  comfort  and  seal  at  high  mask 
cavity  pressures.  The  Air  Force  Operational  Test  and  Evaluation 
Center,  Rapid  Test  and  Evaluation  Directorate  (AFOTEC/TA), 
conducted  this  evaluation  of  prototype  mask  inserts  using  Air 
National  Guard  pilots  flying  training  sorties  in  F- 1 6  aircraft. 

2.0  Methodology . 4 

The  evaluation  addresses  the  operational  use  of  an  aircrew 
oxygen  mask  insert.  The  objective  was  to  evaluate  mask 
comfort  and  mask  seal.  A  pre-evaluation  questionnaire  was 
designed  to  assess  the  comfort  and  seal  of  the  masks  without 
the  insert.  A  post-evaluation  questionnaire  addressed  the 
comfort  and  seal  of  the  mask  with  the  insert. 

3.0  Evaluation  Execution . 9 

It  was  planned  that  each  pilot  would  fly  with  the  insert  for  at  least 
two  sorties.  Each  pilot  had  their  original  mask  without  insert  and 
an  unmodified  mask  with  insert  so  they  could  swap  masks 
between  sorties  and  evaluate  the  seal  and  comfort  of  the  altered 
mask.  Pilots  answered  questionnaires  as  soon  as  possible  after 
the  test  flights. 

4.0  Results . . . 11 

Eighteen  pilots  evaluated  the  insert.  Five  pilots  reported  previous 
seal  problems.  All  five  pilots  indicated  the  insert  improved  the 
mask  seal  and  they  would  continue  using  the  insert.  However, 
most  pilots  indicated  there  was  a  problem  with  the  comfort  of 
the  mask  with  the  insert. 

5.0  Summary . 24 

There  was  an  insufficient  sample  size  to  make  a  statistical 
determination  of  the  mask  insert  improvement.  Seven  of  18 
pilots  stated  they  would  continue  to  use  the  mask  insert  as  it 
improved  the  mask  seal.  However,  these  pilots  were  split  on 
the  issue  of  improved  comfort,  and  half  reported  that  comfort 
decreased  with  the  insert.  More  testing  is  needed  with  a  larger 
sample  size  to  make  a  statistical  determination  regarding  the 
benefits  of  the  mask  insert. 


Preceding  Page  Blank 


8.  Would  you  continuo  to  USE  THE  MASK  INSERT? 

- 1 - 


Ye#  Rotponio  No 


Q  With  PttvfouiScil  Problem*  □  With  Previou*  Comfort  Problem* 

D  Without  PrtvJoui5.il  Problem*  P  Without  Pttvlou*  Comfort  Problem* 

■  All _ 


iii 


AAOM  Mask  Insert  Evaluation  Report 


January  1998 


List  of  Tables 

Table  Eage 


2- 1  Evaluation  objectives  and  associated  issues,  derived  through  SME  interviews . 5 

2- 2  Traceability  matrix:  evaluation  objectives  to  questions . 7 

3- 1  Demographic  data . 10 

4- 1  Rank  of  evaluation  participants . H 

4-  2  Responses  to  potential  mask  insert  problem  areas . 15 

4-3  Problem  areas  for  mask  insert  compatibility  question . 16 

4-4  Problem  areas  for  mask  insert  material  question . 17 

4-5  Problem  areas  for  mask  insert  comfort  question . 18 

4-  6  Problem  areas  for  mask  insert  use  question . 20 

List  of  Figures 

Figure  Esgfi 


1- 1  MBU-20/P  oxygen  mask . 1 

1  -2  Insert  for  MBU-20/P  oxygen  mask . 2 

2- 1  Evaluation  methodology . 4 

2-2  Question  format . 6 

2- 3  Response  scale  definitions . 7 

3- 1  Armstrong  Laboratory  representative  demonstrates  mask  insert . 9 

3-2  The  manside  pressure  tester  with  pilot  helmet . 9 

3- 3  A  pilot  receiving  a  fit  of  his  mask . 16 

4- 1  Average  flight  experience  of  evaluation  participants . 11 

4-2  Mask  sizes  used  during  the  evaluation . 12 

4-3  Seal  rating  provided  by  the  mask  without  the  insert . 12 

4-4  Comfort  rating  provided  by  the  mask  without  the  insert . 13 

4-5  Total  sorties  and  maximum  hours  flown  per  pilot . 14 

4-6  Seal  rating  provided  by  the  mask  with  the  insert . 14 

4-7  Mask  seal  rating  with  insert . 15 

4-  8  Compatibility  of  the  mask  insert  with  existing  equipment . 16 

4-9  Performance  rating  of  the  mask  insert  material . 17 

4-10  Comfort  rating  provided  by  the  mask  with  the  insert . 18 

4-11  Mask  modified  by  pilot . 1  ^ 

4-12  Mask  comfort  rating  with  the  insert . 20 

4-13  Rating  of  overall  use  of  mask  with  insert . 20 

4-14  Did  the  insert  improve  the  seal  of  the  mask? . 21 

4-15  Did  the  insert  improve  the  comfort  of  the  mask? . 22 

4-16  Would  you  continue  to  use  the  mask  insert? . 22 

4-17  Seal  improvement  and  continued  use  summary . 23 

4-18  Comfort  improvement  and  continued  use  summary . 23 


iv 


AAOM  Mask  Insert  Evaluation  Report 


January  1998 


List  of  Appendices 

Appendix  Page 

A  AAOM  Mask  Insert  Evaluation  Questionnaires . A- 1 

B  Sampling  Matrix  Computations . B  - 1 

C  Acronyms . C- 1 


AAOM  Mask  Insert  Evaluation  Report 


V 


January  1998 


1.0  Introduction 


1.1  Background 


The  Crew  Technology  Division  of  Armstrong  Laboratory  (ALCFT)  is  developing  an  insert  for 
the  MBU-20/P  aircrew  oxygen  mask.  The  program,  known  as  the  Advanced  Aircrew 
Oxygen  Mask  (AAOM),  has  as  an  objective  to  enhance  the  comfort  and/or  seal  of  the 
silicone  rubber  face  piece  for  the  MBU-20/P  oxygen  mask,  shown  in  Figure  1  - 1 .  Initial  testing  con¬ 
cluded  that  “the  mask  insert  appears  to  improve  the  ability  to  seal  the  mask  efficiently,  but  there  is 
insufficient  evidence  to  conclude  that  it  improves  comfort.”1  It  is  estimated  that  40  percent  of  pilots  have 
comfort  or  seal  problems  with  the  current  oxygen  mask.  The  Air  Force  Operational  Test  and  Evaluation 
Center,  Rapid  Test  and  Assessment  Directorate  (AFOTEC/TA),  formerly  the  Defense  Evaluation 
Support  Activity  (DESA),  was  asked  by  ALCFT  to  plan  and  conduct  an  evaluation  of  a  prototype 
mask  insert  designed  to  meet  the  program  objectives. 


ALCFT  provided  40  prototype  inserts  to  AFOTEC/ 

TA  in  March  1997  for  the  evaluation.  The  field  evaluation 
was  conducted  using  Air  National  Guard  (ANG)  pilots 
assigned  to  the  following  Fighter  Wings : 

•  Rutland  Air  Force  Base  (AFB),  New  Mexico 
ANG,  150th  Fighter  Wing 

•  Fort  Smith,  Arkansas,  Arkansas  ANG,  1 88th 
Fighter  Wing 

•  Buckley  Field,  Colorado,  140th  Wing 

•  Montgomery,  Alabama  ANG,  1 87th  Fighter  Wing 

•  United  Kingdom  Air  National  Guard  (UKANG), 
one  pilot. 

Figure  1-1.  MBU-20/P  oxygen  mask 


1.2  Mask  Insert  Description 

The  insert,  shown  in  Figure  1  -2,  is  constructed  of  a  Kydex™  frame  which  supports  a  urethane  rim 
that  bolsters  the  face  piece  reflective  seal.  The  insert  is  placed  into  the  mask  and  is  designed  to  enhance 
comfort  and/or  seal  at  high  mask  cavity  pressures  and  high  gravity  forces  (G-forces)  by  ensuring  the 
mask  seal  lays  flat  against  the  user’s  face.  The  frame  of  the  insert  is  designed  with  two  strips  of 
Kydex™  that  cross  the  mask’s  valsalva  ports,  allowing  the  user  to  collapse  the  insert  over  the  nose  to 
facilitate  closing  off  the  nasal  passages  when  performing  a  valsalva  maneuver.  Other  benefits  may  include 
improved  acoustics  within  the  mask  cavity  and  decreased  mask  cavity  dead  space.  Since  the  insert  is 
inexpensive  and  not  permanently  fixed  to  the  mask,  it  can  be  used  on  an  “as  needed”  basis  and  periodi¬ 
cally  replaced  as  necessary. 


1  Diesel,  Donald  A.,  Major,  USAF,  BSC,  1997.  A  Conformal  Foam  Insert  to  Improve  Comfort  and  Function  of  the  MBU-20/P  Positive 
Pressure  Breathing  Oxygen  Mask.  SAFE  Journal.  Vol.  27,  No.  2.  p.  104-108. 
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1 .3  Scope  of  Evaluation 

This  evaluation  addressed  the  operational  use  of  an 
aircrew  oxygen  mask  insert.  The  seal  and  comfort  of  the  mask 
with  the  insert  was  evaluated  via  subjective  questionnaires 
administered  to  pilot  users.  Pilots  were  solicited  on  a  voluntary 
basis.  The  target  pilot  population  was  those  who  had  either  seal 
or  comfort  problems  with  the  MBU-20/P  oxygen  mask,  and 
therefore  could  benefit  from  the  insert.  This  document  reports 
the  findings  from  the  evaluation. 


1 .4  Constraints  and  Limitations 

Figure  1-2.  Insert  for  MBU-20/P  The  evaluation  was  resource  constrained  (time  and  funding), 
oxygen  mask  AFOTEC/TA  attempted  to  maximize  data  collection  and 

minimize  expenditures  by  using  electronic  data  collection 
methods  and  telephone  interviews  whenever  possible.  While  this  approach  helped  to  conserve  scarce 
resources,  it  was  a  constraint  on  the  amount  of  data  collected. 

To  determine  the  appropriate  sample  size,  AFOTEC/TA 
analysts  used  assumptions  concerning  the  population  of 
potential  insert  users,  and  identified  an  appropriate  sampling 
error  and  confidence  level.  Based  on  this,  a  sample  size  of  57 
volunteers  was  required  to  respond  to  the  program  objectives. 

However,  there  were  only  40  inserts  available  fortesting,  and 
even  fewer  pilots  participating.  The  final  count  of  volunteers 
was  1 8,  and  was  not  sufficient  for  a  statistically  significant 
conclusion.  However,  the  discrete  results  from  the  1 8  pilots 
were  included  in  this  evaluation. 

Results  could  vary  between  guard  units  as  each  life  sup¬ 
port  shop  fit  the  mask  with  the  insert  for  their  pilots.  The  fit  of 
the  mask  affects  the  results  of  the  evaluation,  and  life  support 
shops  may  use  slightly  different  techniques.  Another  fit  prob¬ 
lem  that  may  have  occurred  is  fife  support  being  unfamiliar  with 
the  insert.  For  example,  the  size  of  the  insert  is  critical  to  the 
seal  and  comfort  experienced  by  the  pilot.  The  bulk  of  the 
insert  may  also  cause  the  size  of  the  mask  to  feel  smaller. 

Some  pilots,  therefore,  may  have  needed  a  larger  mask  with 
the  insert  than  they  typically  wore.  This  problem  should  be 
resolved  with  more  training  and  familiarity  with  the  mask  insert. 


Life  support  personnel  pressure 
testing  a  pilot’s  mask  with  the  new 
insert  added  using  the  manside 
pressure  test 


AAOM  Mask  Insert  Evaluation  Report 


2 


January  1998 


Four  of  1 8  pilots  did  not  have  their  masks  fit  by  life  support  personnel.  These  pilots  were 
included  in  the  analysis.  However,  one  of  these  pilots  modified  his  mask  insert  after  initial  testing  to 
improve  comfort.  This  modification  is  discussed  in  Section  4.4.4. 

Some  volunteers  stated  that  they  did  not  have  seal  or  comfort  problems  with  the  current 
MBU-20/P  oxygen  mask.  The  original  plan  was  to  remove  these  individuals  from  the  evaluation,  since 
the  evaluators  believed  this  would  skew  the  results.  However,  these  pilots  also  had  thoughtful  comments 
and  suggestions  concerning  the  insert  and  all  pilots  were  included  in  the  evaluation. 
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2.0  Methodology 


2.1  Evaluation  Methodology 


T! 


e  methodology  developed  for  this  evaluation  is  depicted  in  Figure  2- 1 .  This  methodology 
was  documented  in  the  Advance  Aircrew  Oxygen  Mask  Insert  Evaluation  Execution  Plan, 
February  1997,  developed  by  DESA,  prior  to  transition  to  AFOTEC/TA. 
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Figure  2-1.  Evaluation  methodology 


2.2  Define  Problem 


The  problem  definition  phase  focused  on  interviews  with  two  subject  matter  experts  (SMEs),  both 
retired  fighter  pilots,  to  determine  the  important  objectives/issues  associated  with  mask  insert  usage. 

The  interviews  helped  identify  the  major  objectives  of  the  evaluation:  determine  mask  seal  and 
comfort  with  the  mask  insert.  The  interviews  also  revealed  some  secondary  objectives.  These 
subobjectives  included  ease  of  use,  compatibility  with  existing  equipment,  and  performance  of  the  insert 
material.  Table  2-1  presents  the  objectives,  subobjectives,  and  issues  derived  from  the  interview  pro¬ 
cess. 

2.2.1  Mask  Seal 

As  seen  in  Table  2- 1 ,  the  primary  factors  thought  to  directly  affect  mask  seal  were  G-loading 
(positive  and  negative),  altitude,  and  the  ability  to  perform  a  valsalva  maneuver.  It  is  important  to  note 
these  factors  influence  the  seal  provided  by  any  mask,  regardless  of  insert  presence.  Thus,  while  no 
insert-specific  factors  were  identified,  the  focal  point  of  the  evaluation  was  the  ability  of  the  insert  to 
alleviate  the  effect  of  these  factors  on  mask  seal. 


Insert  compatibility.  As  a  subobjective,  compatibility  of  the  insert  with  existing  equipment  was 
thought  to  have  a  less  direct  impact  on  mask  seal.  Further,  the  issues  associated  with  this  subobjective 
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Table  2-1.  Evaluation  objectives  and  associated  issues,  derived  through  SME  interviews. 


Objectives 

Subobjectives 

Issues  to  Be  Assessed 

1 .0  Does  the  insert  improve  mask  seal? 

G  loading  Altitude 

Valsalva 

1. 1  Is  the  insert  compatible  with 
existing  equipment? 

Microphone/speaking 

Mask  release  interference 
Vision  interference 

Helmet  interference 

Visor  interference 

Pressure  breathing 
Regulator  flow 

1.2  Is  the  insert  material  suitable 
for  the  mask  environment? 

Ambient  conditions: 

-Heat 

-Humidity 

-Cold 

-Vapor 

Contact/hygiene: 

-Saliva/perspiration 

-Bacteria/fungus 

-Growth 

-Deterioration 

-Cleaning/maintenance 

2.0  Does  the  insert  improve  mask 
comfort? 

Length  of  sortie 

G-loading 

Altitude 

Eyeglasses 

Irritation 

Sagging 

Changes  over  time 

2. 1  Is  the  insert  easy  to  use? 

Installation 

Removal 

Stay  in/fall  out 

Pre-flighting  the  mask 
Stability  during 
cockpit  movement 

were  generally  unique  to  the  insert;  that  is,  current  masks  were  assumed  not  to  interfere  with  the  items  or 
activities  identified  in  Table  2-1  (microphone,  visor,  pressure  breathing,  etc.).  However,  because  the 
insert  has  bulk,  it  may  cause  the  mask  to  interfere  with  these  items  or  activities. 

Insert  material.  While  this  subobjective  cannot  be  definitively  addressed  in  a  subjective  evaluation, 
the  intent  of  its  inclusion  was  to  capture  any  occurrences  where  ambient  conditions  or  contact  were 
thought  to  adversely  affect  the  mask. 

2.2.2  Mask  Comfort 

The  second  objective  of  the  evaluation  was  to  evaluate  the  extent  to  which  mask  comfort  is  im¬ 
proved  by  the  insert.  As  with  the  first  objective,  most  issues  associated  with  comfort  are  not  unique  to 
the  insert,  but  apply  to  any  mask.  Two  issues  emerged  as  generally  unique  to  the  insert — interference 
with  eyeglasses  and  changes  to  the  material  over  time.  The  former  is  a  possible  factor  due  to  the  bulk  of 
the  insert  and  the  latter  because  material  changes  may  impact  comfort,  as  well  as  seal. 

Insert  Ease-of-Use.  A  subobjective  of  comfort  is  ease-of-use.  While  ease-of-use  may  not  directly 
affect  mask  seal  or  comfort,  it  can  affect  whether  the  insert  is  used  in  the  field. 

2.3  Design  of  Evaluation 

Design  of  the  evaluation  focused  on  questionnaire  development  and  identification  of  sampling 
requirements.  Additionally,  test  block  locations  and  duration  were  specified. 
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2.3.1  Questionnaire  Development 

Two  questionnaires  were  developed  for  this  evaluation.  A  pre-evaluation  questionnaire  was  de¬ 
signed  to  assess  the  seal  and  comfort  of  the  current  mask,  without  insert,  and  obtain  mask  size  to 
provide  the  proper  insert.  The  pre-evaluation  questionnaire  was  administered  in  paper  form,  prior  to  the 
start  of  the  assessment. 

A  post-evaluation  questionnaire  addressed  the  AAOM  mask  insert  evaluation  objectives.  The 
questionnaire  contained  nine  questions  and  was  administered  to  pilots  upon  completion  of  their  evalua¬ 
tion  sorties.  Response  to  the  questions  was  done  electronically  on  the  AFOTEC/TA  website  using  a 
laptop  or  desktop  computer  with  internet  access.  The  advantages  of  this  data  collection  method  were: 

1)  No  travel  required  by  the  evaluators  to  collect  data;  2)  Accurate  data  entry;  and  3)  Uniform  and 
non-biased  presentation  of  the  questionnaire  to  each  pilot.  For  the  few  pilots  who  did  not  have  internet 
access,  personal  or  telephone  interviews  were  conducted  by  the  AFOTEC/TA  evaluator.  Both  ques¬ 
tionnaires  can  be  found  in  Appendix  A. 

2.3.2  Question  Format 

Figure  2-2  illustrates  the  question  format  and  response  scale  employed  for  the  post-evaluation 
questions  (pre-evaluation  questions  followed  the  same  format,  without  the  problem  area  section).  This 
format  reduced  response  burden,  by  simply  checking  problem  areas.  With  the  on-line  data  entry 
method,  problem  areas  were  only  visible  to  the  pilot  if  an  “unacceptable”  rating  (4-6)  was  given.  This 
was  done  to  avoid  biasing  the  pilot.  A  comment  area  was  available  for  open-ended  comments,  regard¬ 
less  of  the  rating  provided. 


1 .  Rate  the  SEAL  provided  by  your  mask  WITH  the  insert: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas: 

_ Leaks  at  high  Gs 

_ Leaks  at  negative  Gs 

_ Leaks  at  high  altitudes 

_ Leaks  at  low  altitudes 

_ Leaks  all  the  time 

_ Interferes  with  effective  valsalva  maneuver 

_ Other  (specify,  in  comment  area) 


Comment: 

■  Hi  '  -  Jr  .v  •v*  H*'-  *  >*-' 

Visibleionlypitlr ft* 

f:;a-4,fSr-or;6^i 


Figure  2-2.  Question  format 
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Response  scale.  The  response  scale  illustrated  in  Figure  2-2  was  a  balanced,  6-point  Likert  scale 
using  labels  ranging  from  Completely  Acceptable  (1)  to  Completely  Unacceptable  (6).  Figure  2-3 
provides  definitions  for  the  scale  labels. 


Completely  Acceptable  -  The  insert  is  fine  the  way  it  is;  no  improvement  required. 

Mostly  Acceptable  -  The  insert  meets  its  intended  purpose;  it  could  be  improved  to 
make  it  easier  or  more  efficient. 

Somewhat  Acceptable  -  The  insert  meets  its  intended  purpose  with  some 
reservations.  Meets  minimum  requirements  to  accomplish  mission/task. 

Somewhat  Unacceptable  -  Minor  problems  encountered  with  the  insert.  Task 
accomplished  with  some  difficulty.  Some  degradation  of  mission/task  accomplishment 
or  accuracy. 

Mostly  Unacceptable  -  Major  problems  encountered  with  the  insert.  Task 
accomplished  with  great  difficulty  or  accomplished  poorly.  Significant  degradation  of 
mission/task  accomplishment  or  accuracy. 

Completely  Unacceptable  -  The  insert  is  unusable  or  unsafe.  Mission/task  not 
accomplished  due  to  equipment  deficiencies  or  procedural  limitations. 


Figure  2-3.  Response  Scale  Definitions 


Table  2-2  provides  the  Traceability  Matrix,  linking  objectives  and  subobjectives  to  evaluation 
questions  (complete  text  of  each  question  can  be  found  in  the  post-evaluation  questionnaire  in  Appendix 
A).  The  pre-evaluation  questions  relate  to  the  seal  and  comfort  of  respondents’  mask  without  the  insert. 
As  acceptance  of  the  mask  insert  may  be  influenced  by  current  mask  performance,  it  was  important  to 
know  if  a  need  for  improvement  existed. 


Table  2-2.  Traceability  Matrix:  Evaluation  Objectives  to  Questions 


Objective  1 .0 

Does  the  insert  improve  mask  seal? 

1 .  Rate  the  SEAL  provided  by  your  mask  WITH  the  insert. 

Subobjective  1 .1 

Compatibility  with  existing  equipment 

3.  Rate  the  COMPATIBILITY  of  the  MASK  INSERT  with  existing 
equipment. 

Subobjective  1 .2 

Is  the  insert  material  suitable  for  the 
mask  environment? 

4.  Rate  the  performance  of  the  MASK  INSERT  MATERIAL. 

Objective  2.0 

Does  the  insert  improve  mask 
comfort? 

2.  Rate  the  COMFORT  of  your  mask  WITH  the  insert. 

Subobjective  2.1 

Is  the  insert  easy  to  use? 

5.  Rate  the  overall  USE  of  the  MASK  INSERT. 

Finally,  the  questionnaire  concluded  with  three  “Yes/No”  questions  not  included  in  the  SME  objectives. 
These  questions  were : 

6.  Did  the  insert  IMPROVE  THE  SEAL  of  your  mask? 

7.  Did  the  insert  IMPROVE  THE  COMFORT  of  your  mask? 

8.  Would  you  continue  to  USE  THE  MASK  INSERT? 
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These  questions  were  designed  to  test  the  hypothesis  that  the  insert  improves  mask  seal/comfort.  The 
questions  that  form  the  body  of  the  text  (questions  1  through  5)  were  used  to  identify  the  underlying 
reasons  for  mask  acceptance/rejection. 

2.3.3  Sample  Size  Requirement 

Development  of  the  sampling  matrix  rested  on  several  assumptions,  identified  by  AFOTEC/TA  and 
the  insert  developers: 

•  The  F- 1 6  pilot  population  is  roughly  1 ,300. 

•  Forty  percent  of  F-16  pilots  have  problems  with  their  mask  (1300  x  0.40  =  520). 

•  The  mask  insert  must  improve  performance  and  comfort  for  at  least  7 5  percent  of  those  with 
problems  (520  x  0.75  =  390). 

•  Therefore,  the  minimum  acceptance  rate  is  30  percent  (390/1300). 

•  A  confidence  level  of  95  percent,  with  a  1 0  percent  error  rate  is  required. 

•  A  one-tailed  test  of  significance  is  appropriate. 

Given  these  assumptions,  a  required  sample  size  of  57  inserts  was  derived,  using  the  formula  for  a 
binomial  distribution  described  in  Appendix  B.  However,  it  was  recognized  that  after  data  had  been 
collected,  the  actual  acceptance  rate  could  be  used  to  determine  if  the  confidence  level  and  error  rate 
requirements  had  been  met.  Thus,  if  50  percent  of  20  pilots  (or  more)  reported  the  insert  improved  the 
seal/comfort  of  the  mask,  a  statistical  significance  with  a  confidence  level  of  95  percent  and  an  error  rate 
of  10  percent  would  have  been  reached.  Appendix  B  describes  the  computations  supporting  these 
sample  size  determinations. 

Data  Collection  Schedule.  The  evalua¬ 
tion  comprised  a  number  of  separate  tests 
conducted  at  Kirtland  AFB,  New  Mexico; 

Fort  Smith,  Arkansas;  Buckley  Field, 

Colorado;  and  Montgomery,  Alabama. 

Coordination  with  life  support  personnel  at 
each  location  was  initiated  by  an  Armstrong 
Laboratory  representative.  The  AFOTEC/ 

TA  Project  Leader  followed  up  with  data 
collection  from  each  participating  pilot  and 
informal  interviews  with  life  support  person¬ 
nel.  Data  was  collected  piecemeal  from  April 
through  November  1997.  Delays  were 
caused  by  pilot  deployments,  solicitation  of 
willing  guard  units,  and  pilot  schedules. 


Female  participant  prepares  to  evaluate 
the  mask  insert. 
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3.0  Evaluation  Execution 


Execution  of  the  evaluation  included  preparation  of  pilots  and  life  support  participants  (see 
Figure  3-1),  along  with  administering  initial  and  final  evaluation  questionnaires.  During  the 
evaluation,  the  AFOTEC/TA  Project  Leader  was  available  to  respond  to  pilots’  questions 
and  concerns  and  collect  inserts,  should  pilots  voluntarily  exit  the  evaluation.  Each  evaluation  participant 
completed  a  pre-evaluation  questionnaire  prior  to  the  start  of  the  assessment.  The  post-evaluation 
questionnaire  was  administered  to  pilots  upon  completion  of  their  evaluation  sorties. 


Figure  3-1.  An  Armstrong  Laboratory  representative 
demonstrates  to  life  support  personnel  at  Buckley  ANG  how  to 
use  the  mask  insert. 


3.1  Mask  Fitting  Process 

Life  support  personnel  fitted  a 
mask  and  insert  for  each  pilot  as 
part  of  the  evaluation  preparation. 

The  fitting  and  testing  procedure 
included  performing  a  pressure  test 
using  the  manside  test  set  shown  in 
Figure  3-2.  This  test  allows  the  pilot 
to  check  the  seal  of  the  modified 
mask  under  different  pressures.  The 
pilot  wears  an  upper  pressure 
garment  consisting  of  a  pressurized 
vest.  The  vest  pressure  would  be 
varied  to  simulate  flight  conditions 
while  the  pilot  evaluated  the  mask 
insert  seal.  The  tester  can  simulate 
pressures  up  to  9  to  10  G  forces2. 

Figure  3-3  shows  a  pilot  testing  the 
seal  of  his  mask  with  the  insert  added. 

3.2  Pilot  Testing 

It  was  planned  that  each  pilot  would  fly  with  the 
insert  for  at  least  two  sorties,  unless  they  chose  to 
quit  the  evaluation,  and  each  sortie  would  be  a 
minimum  of  1  hour.  Each  pilot  had  their  original 
mask  and  an  unmodified  mask  with  insert  in  order 
to  swap  masks  between  sorties  to  evaluate  the  seal 
and  comfort  of  the  altered  mask.  Pilots  answered 
questionnaires  as  soon  as  possible  after  the  test 
flights.  All  responses  were  confidential.  Quotes 
from  participants  are  used  in  this  report  by  pilot 
permission. 


Figure  3-2.  The  manside  pressure  tester  with 
pilot  helmet  used  to  test  the  seal/fit  of  the  pilot’s 
mask. 


:G  Forces  Definition 

G  =  Gravity;  1G  =  Normal  weight  at  sea  level;  2Gs  =  Twice  the  normal  weight  at  sea  level;  lOGs  =  Ten  times  the  normal  weight 
at  sea  level 
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Figure  3-3.  Pilots  were  fitted  with  a  mask  and 
insert  as  part  of  the  evaluation  preparation  at 
Buckley  ANG. 


3.3  Data  Collection 

Data  collection  involved  administering  the  pre¬ 
evaluation  questionnaire  addressing  current  mask 
seal  and  comfort,  and  a  post-evaluation  question¬ 
naire  addressing  mask  seal  and  comfort  with  the 
mask  insert.  The  pre-evaluation  questionnaire  was 
administered  via  hard  copy  in  a  group  setting  by 
either  life  support  or  by  the  AFOTEC/TA  Project 
Leader.  All  pilot  demographic  information  was 
collected  at  this  time.  These  questionnaires  were 
entered  into  the  database  by  AFOTEC/TA. 

Pilots  responses  were  stored  in  the  database, 
identified  by  social  security  number  (SSN).  Some 
pilots  chose  to  exit  the  evaluation  (by  informing  life 
support  and  returning  the  insert)  before  the  evalua¬ 
tion  was  completed. 

Demographic  data  were  collected  to  assist 
analysis  during  the  evaluation.  Table  3-1  shows  the 
demographic  data  fields  and  their  purpose. 


Table  3-1.  Demographic  Data 


SSN  (4) 

Track  pilot  status  &  responses 

Last  Name 

Track  pilot  status  &  responses 

Gender 

Classify  sample/responses 

Rank 

Classify  sample/responses 

Time  in  Rank 

Classify  sample/responses 

Total  Flvinq  Hours 

Classify  sample/responses 

Hours  Flvinq  F-16 

Classify  sample/responses 

Number  of  sorties 
flown  with  mask  insert 

Classify  sample/responses 

Insert  ID 

Track  inserts 
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4.0  Results 


4. 1  Number  of  Participants 

There  was  a  general  reluctance  on  the  part  of  the  pilot  population  to  state  that  they  were 

having  a  problem  with  the  MBU-20/P  oxygen  mask  and  request  alterations  of  their  current 
mask.  One  possible  reason  for  this  reluctance  was  the  requirement  to  fit  the  mask  with  an 
insert  and  perform  a  pressure  test.  Another  reason  for  poor  pilot  participation  was  the  lack  of  support 
from  the  command  structure  of  the  participating  units.  As  a  result,  only  1 8  pilots  participated  in  the 
evaluation.  Although  the  number  of  participants  is  low,  the  data  gathered  is  still  useful  to  the  AAOM 
program. 

4.2  Population  Demographics 

Demographic  information  from  the  pre-evaluation  questionnaire  was  analyzed  to  determine  if  the 
sample  population  was  representative  of  F-16  pilots  as  a  whole. 

There  were  1 8  pilots  participating  in  this  evaluation.  They  ranged  from  02  to  06  in  rank,  with  one 
non- American  and  one  female  pilot.  They  had  F-16  flight  experience  ranging  from  a  minimum  of  410 
hours  to  1 ,200  hours.  Table  4- 1  shows  the  rank  of  the  participants,  and  Figure  4- 1  shows  their  average 
flight  experience.  The  participants  used  all  mask  insert  sizes  [small/narrow  (S/N),  medium/narrow  (M7 
N),  medium/wide  (MAV),  and  large/wide  (LAV)]  during  the  evaluation  as  shown  in  Figure  4-2. 


Table  4-1.  Rank  of  evaluation  participants 


Rank 

Number  of  Participants 


02  03 

04 

05 

06 

1  7 

4 

3 

2 

Figure  4-1.  Average  flight  experience  of  evaluation 
participants. 


4.3  Mask  Without  Insert 

Pilots  were  asked  in  the  pre¬ 
evaluation  to  rate  their  current  mask, 
without  insert,  in  terms  of  seal  and 
comfort,  and  provide  comments  as 
necessary  to  explain  their  ratings. 
The  first  question  addressed  the 
seal  of  the  mask  without  the  insert. 
The  responses  ranged  from  “Com¬ 
pletely  Acceptable”  to  “Somewhat 
Acceptable,”  as  shown  in  the  graph 
of  Figure  4-3.  Positive  comments 
from  the  participants  included 
(‘Good  fit,  no  leaks  or  problems 
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Despite  the  acceptable  ratings,  there 
were  complaints,  including  the 
following: 

•  Does  the  job  -  Just  not 
comfortable.  Also,  does 
not  allow  valsalva. 

•  Mask  has  to  be  almost 
uncomfortably  tight  to 
maintain  a  good  seal 
during  peak  combat  edge 
operations. 

•  Leaks  under  G  when  .. 

pressure  breathing  begins.  Figure  4-2.  Mask  sizes  used  during  evaluation.  (One  p  ot 

•  It  leaks  around  the  nose.  did  not  provide  mask  size.) 

•  Mask  seals  fine,  sometimes 

leaks  under  high  G  -  leaks  while  moving  head. 

•  It  has  never  sealed  really  right.  I  have  to  tighten  it  extremely  tight  to  where  it  hurts. 


Figure  4-3.  Only  one  pilot  stated  an  unacceptable  rating  for  his  mask  seal, 
however,  there  is  a  general  reluctance  of  pilots  to  admit  problems. 


All  five  pilots  rating  the  seal  as  “Somewhat  Acceptable”  or  below,  indicated  they  had  leak  problems 
in  their  comments. 

Pilots  were  also  asked  to  rate  the  comfort  of  the  current  mask.  The  responses  ranged  from  “Com¬ 
pletely  Acceptable”  to  “Completely  Unacceptable”  as  shown  in  Figure  4-4.  Positive  comments  con¬ 
cerning  the  comfort  of  the  present  mask  included  “ Completely  Comfortable”  and  “Not  as  good  as  a 
12/P,  but  acceptable.  ”  Complaints  concerning  the  comfort  of  the  current  mask  included: 

•  Not  very! 

•  Tightness  in  nasal  area  is  better  than  the  old  style  non  combat-edge  but  still  present 
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•  There’s  not  enough  room  for  my  nose  -  it  hits  the  microphone .  The  old  mask  (12/P)  (Prior 

to  the  combat  edge)  fit  like  a  glove . 


1.  Rate  the  COMFORT  provided  by  your  mask  WITHOUT  the  insert: 


10 

9 

e- 


I  Vi..;.,  2  3  4  5  6 

Compt«t«ly  $om*what  Somewhat  Mottly  Compl#t*ly 

Acc«pfabtV  AccpptcfcU  Unacc«ptcbl#  Unacc»p»abU  Unacc»ptcbl» 


Figure  4-4.  There  were  more  comfort  problems  than  seal  problems . 

4.4  Insert  Evaluation 

During  the  course  of  the  evaluation,  1 8  pilots  used  the  insert  on  53  sorties  and  completed  evaluation 
questionnaires.  Two  pilots  completed  a  total  of  1 0  sorties  each  with  the  mask  insert,  while  six  pilots 
completed  only  one  sortie  with  the  insert.  The  maximum  number  of  hours  using  the  insert  on  any  given 
sortie  was  2.7,  and  the  minimum  was  0.5 .  Figure  4-5  shows  the  maximum  time  and  number  of  sorties 
flown  by  pilot  with  the  insert. 

4.4. 1  Objective  1.0:  Insert  Seal  Evaluation 

Pilots  rated  the  seal  provided  by  the  mask  with  the  insert  as  shown  in  Figure  4-6.  This  chart  catego¬ 
rizes  pilot  responses  according  to  whether  they  indicated  seal  problems  with  the  original  mask.  Five  of 
the  18  pilots  had  been  identified  as  having  seal  problems  from  the  pre-evaluation  questionnaire.  Note 
that  83.3  percent  of  all  pilots  rated  the  seal  of  the  mask  with  insert  in  the  “Acceptable”  range  (Com¬ 
pletely,  Mostly,  or  Somewhat  Acceptable),  and  16.7  percent  rated  the  seal  in  the  “Unacceptable”  range 
(Completely,  Mostly,  or  Somewhat  Unacceptable).  Also  note  that  the  ratings  improved  for  all  pilots  with 
previous  seal  problems.  This  implies  the  insert  does  improve  the  seal  for  pilots  who  need  a 
better  seal. 

The  pilots  who  responded  in  the  unacceptable  range  were  also  asked  to  describe  any  leakage 
problems  by  using  a  check  list  of  possible  problem  descriptions  and  entering  comments.  The  responses 
are  shown  in  Table  4-2. 
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Figure  4-5.  Two  pilots  flew  at  least  2.5  hours  in  one  sortie  and  at 
least  seven  sorties  total. 


1.  Rate  the  SEAL  provided  by  your  mask  WITH  the  insert: 


l  2  3  4  5  6 

Completely  Mostly  Somewhat  Somewhat  Mostly  Completely 

Acceptable  Acceptable  Acceptable  Unacceptable  Unacceptable  Unacceptable 

'  ,T  Rating 

Figure  4-6.  Most  pilots  rated  the  seal  provided  by  the  mask  with  the  insert  in  the 
“Acceptable”  range.  Only  five  pilots  had  previous  seal  problems;  four  of  them  rated  the 
new  seal  as  “Completely  Acceptable”  and  one  rated  it  as  “Mostly  Acceptable.” 
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Comments  concerning  the  seal  of  the  mask  with  the  Table  4-2.  Responses  to  potential  mask 

insert  included: 

•  The  seal  far  exceeded  my  expectations  and  it’s 
much  more  comfortable. 

•  The  seal  was  great. 

•  Would  work  fine  if  someone  had  a  leak  prob¬ 
lem. 

•  The  mask  slipped  off  and  air  came  over  the 
top  of  it  into  my  eyes.  This  mask  was  riot 
refitted  for  the  insert. 

•  It  didn ’t  seal  as  well  with  the  insert  as  without 
the  insert.  The  insert  made  the  seal  more  rigid. 

Each  pilot’s  rating  of  the  mask  seal  without  the  insert  was  compared  to  the  rating  of  the  mask  seal 
with  the  insert.  Figure  4-7  shows  that  information  summarized  in  three  categories  “Better,”  “Same,”  and 
“Worse,”  and  categorized  by  previous  seal  problems . 


insert  problem  areas. 


Leaks  at  high  Gs 

2 

Leaks  at  negative  Gs 

0 

Leaks  at  high  altitudes 

1 

Leaks  at  low  altitudes 

1 

Leaks  all  the  time 

1 

Interferes  with  effective 
valsalva  maneuver 

1 

Mask  Seal  Rating  WITH  Insert 


Better  Same  Worse 

1  ■  Rating 


Figure  4-7.  All  pilots  who  had  some  previous  seal  problems  rated  their  new  seal  as 
better  than  before. 

Seal  Evaluation  Summary.  Most  pilots  rated  the  seal  with  the  insert  in  the  acceptable  range:  83.3 
percent  acceptable  and  16.7  percent  unacceptable.  Additionally,  aU  pilots  reporting  previous  seal 
problems  rated  the  seal  of  the  mask  with  the  insert  as  better  than  the  seal  of  the  mask  without  the  insert. 
Problems  were  identified  due  to  the  insert  slipping  and  the  rigid  nature  of  the  insert. 


4.4.2  Subobjective  1.1:  Compatibility  with  Existing  Equipment 

Compatibility  of  the  insert  with  existing  equipment  was  addressed  as  a  subobjective  of  the  mask  seal 
because  the  insert  has  bulk  and  therefore  may  cause  interference  with  microphone,  visor,  etc.  The 
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responses,  shown  in  Figure  4-8  indicate  that  72.2  percent  of  the  pilots  rated  the  mask  insert  as  accept¬ 
able  in  terms  of  compatibility  with  existing  equipment. 


3.  Rate  the  COMPATABILITY  of  the  MASK  INSERT  with  existing  equipment. 
10  - - — - 


1  2  3  4  5  6 

Completely  Mostly  Somevhat  Somewhat  Mostly  Completely 

Acceptable  ?  7^  \Aooeptable  Acceptable  Unacceptable  Unacceptable  Unacceptable 


Figure  4-8.  Compatibility  of  the  mask  insert  with  existing  equipment. 


Pilots  who  responded  in  the  unacceptable  range  were  also  given  the  opportunity  to  respond  using  a 
check  list  of  potential  problem  areas  and  using  comments.  The  check  list  responses  are  shown  in  Table 
4-3. 


The  comments  provided  included  the  following: 

•  Did  not  notice  very  much  except  that  it 
was  a  little  harder  to  valsalva  with  the 
mask  on. 

•  Not  completely  compatible  as  my  mask 
STILL  does  not  completely  allow  for  a 
valsalva. 

•  Interferes  with  my  ability  to  talk. 


Table  4-3.  Problem  areas  for  mask  insert 
compatibility  question. _ 


Interferes  with  vision 

0 

Interferes  with  microphone  use 

0 

Interferes  with  mask  release 

1 

Interferes  with  visor 

1 

Adversely  affects  pressure 

2 

breathinq 

Adversely  affects  reaulator  flow 

0 

Compatibility  Summary.  Seventy-two  percent  of 

the  pilots  rated  the  insert  in  the  acceptable  category,  however  there  were  compatibility  problems  re¬ 
ported  such  as  mask  release,  visor  interference,  adverse  affects  during  pressure  breathing,  problems 
performing  the  valsalva  maneuver,  and  problems  talking. 


4.4.3  Subobjective  1.2:  Insert  Material  Suitability 


The  intent  of  this  subobjective  was  to  capture  any  occurrences  where  ambient  conditions  or  contact 
were  thought  to  adversely  affect  the  mask.  This  would  include  the  operating  environment  such  as  heat, 
cold,  and  humidity  as  well  as  the  human  operating  environment  resulting  from  skin  contact,  saliva, 
perspiration,  etc.  The  question  and  responses  are  graphically  shown  in  Figure  4-9. 
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Figure  4-9.  Although  two  pilots  stated  the  mask  insert  material  was  affected 
by  skin  contact,  the  issue  was  actually  a  discomfort  problem  of  the  mask 
material  on  the  skin. 

Pilots  who  responded  in  the  unacceptable  range  were  also  given  the  opportunity  to  respond  using  a 
check  list  of  potential  problem  areas  and  using  comments.  The  check  list  responses  are  shown  in 
Table  4-4. 

The  comments  provided  included  the  following: 

•  Did  not  notice  any  material  wear. 

•  Might  not  last  that  long,  but  I  had  no 
problems  with  it. 

•  The  only  problem  was  that  it’s  porous  and 
absorbs  sweat  and  moisture. 

Insert  Material  Suitability  Summary.  Most 
pilots  rated  the  performance  of  the  insert  material  as 
acceptable  (83.3  percent),  and  few  problems  were 
reported.  However,  concern  was  raised  about  the  long-term  durability  and  hygiene  issues  relating  to  the 
porous  insert  material  absorbing  sweat  and  moisture. 

4.4.4  Objective  2.0:  Does  the  insert  improve  mask  comfort? 

The  second  objective  of  the  evaluation  was  to  determine  the  extent  to  which  mask  comfort  is 
improved  by  the  insert.  Pilots  were  asked  to  rate  the  comfort  of  the  mask  with  the  insert.  The  re¬ 
sponses,  graphed  in  Figure  4-10,  show  that  only  33.3  percent  of  all  pilots  rated  the  mask  comfort  in  the 
“Acceptable”  range,  while  66.7  percent  rated  the  mask  comfort  in  the  “Unacceptable”  range.  This  is  a 
reversal  of  the  comfort  ratings  for  the  mask  without  the  insert.  Once  again,  the  ratings  shown  in 
the  figure  are  categorized  according  to  presence  or  absence  of  a  prior  comfort  problem. 


Table  4-4.  Problem  areas  for  mask  insert 
material  question. _ , 


Affected  by  heat _ 

Affected  by  cold _ 

Affected  by  humidity 
Affected  bv  oxygen 
Affected  by  skin  contact 
Deteriorated  over  time 


AAOM  Mask  Insert  Evaluation  Report 


17 


January  1998 


1.  Rate  the  COMFORT  provided  by  your  mask  WITH  the  insert: 


Completely  Mostly  Somewhat  Somewhat  Mostly  Completely 

Acceptable  Acceptable  Acceptable  Unacceptable  Unacceptable  Unacceptable 

Rating 

Figure  4-10.  There  were  more  unacceptable  comfort  ratings  than  expected.  Out  of  the 
five  pilots  who  had  previous  comfort  problems,  only  one  rated  the  comfort  of  the  insert 
as  improved. 

The  12  pilots  responding  in  the  unacceptable  range  were  asked  to  check  a  list  of  potential  problem 
areas  and  provide  comments.  They  checked  3 1  problem  areas  as  shown  in  Table  4-5.  Seven  of  the  12 
pilots  indicated  the  insert  caused  irritation.  Four  of  the  12  pilots  indicated  the  insert  was 
uncomfortable  for  lengthy  use,  and  eight  indicated  the  mask  was  uncomfortable  at  all  times. 


Table  4-5.  Problem  areas  for  mask  insert 
comfort  question. 


The  comments  provided  included  the  following: 

•  Very  comfortable  to  wear. 

•  Comfortable,  the  reason  is  the  increased 
surface  area  of  the  seal. 

•  A  little  confining  but  opened  nasal  area 
(improvement)  and  still  kept  the  seal. 

•  Mask  was  very  comfortable,  no  adverse 
comfort  was  noticed. 

•  It’s  too  rough. 

•  Too  hard. 

•  The  mask  was  too  hard  and  became 
very  uncomfortable  after  10  minutes. 

•  The  foam  may  LOOK  smooth,  but  it  is 
exceptionally  rough  on  your  face  and  is 
EXTREMELY  irritating.  The  rubber  seal 
of  the  mask  did  not  cover  the  foam  of 
the  insert.  It  was  like  cutting  the  top  off 

a  tin  can  and  pressing  it  against  your  face.  It  felt  like  sandpaper. 

•  This  caused  irritation  on  the  bridge  of  my  nose. 


Has  to  be  tightened  to  a  point 
that  it  is  uncomfortable 

3 

Interferes  with  eveqlasses 

1 

Causes  irritation 

7 

Causes  the  mask  to  sag 

2 

Uncomfortable  at  higher 
altitudes 

0 

Uncomfortable  at  high  Gs 

3 

Uncomfortable  at  neaative  Gs 

0 

Uncomfortable  during  combat 
maneuvers 

3 

Uncomfortable  for  lengthy  use 

4 

Uncomfortable  at  all  times 

8 
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•  It  felt  too  small  between  the  top  of  my  nose 
to  the  bottom  of  my  mouth  the  inner  part  of 
mask. 

•  The  bottom  part,  under  the  lip,  across  the 
chin  part  of  the  insert  stuck  up  past  the 
mask  and  it  rubbed  the  skin  making  it  raw. 

I  trimmed  off  part  of  the  insert  material  to 
make  it  more  comfortable.  I  flew  three 
sorties  with  the  modified  insert  and  it  was 
great.  (Figure  4- 11  shows  the  mask  insert 
modified  by  this  pilot.) 

Comparison  of  comfort  evaluations  with  and 
without  the  mask  insert  is  shown  in  Figure  4-12. 

Most  pilots  also  indicated  the  mask  insert 
was  both  restrictive  and  an  irritant  This  was 
especially  hue  around  the  nose  and  chin,  where  the 
rigidity  of  the  mask  caused  it  to  mb.  The  foam  insert 
material,  while  appearing  soft,  feels  rough  to  the  user 
when  inserted  in  the  mask.  The  roughness  is  more 
apparent  when  the  mask  is  underpressure  because  the 
expansion  of  the  mask  exposes  the  insert  material.  The 


Figure  4-11.  One  pilot  at  Kirtland  AFB 
modified  his  mask  to  increase  comfort.  (The 
inside  lower  edge  was  cut  back  with  a  razor.) 


“roughness”  may  be  due  to  the  edge  of  the  face  piece  being  pressed  against  the  face  by  the  insert.  This 


would  create  a  sharp  edge  of  silicone  rubber  pressing  against  the  skin.  Apparently,  from  laboratory 


testing,  the  insert  designers/manufacturers  knew  there  might  be  a  problem  with  bottom  lip  area. 


Figure  4-12.  Comparison  of  comfort  rating  with  and  without  the  mask  insert. 
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Comfort  Summary.  Only  33.3  percent  of  the  pilots  rated  the  mask  comfort  in  the  “Acceptable” 
range,  while  66.7  percent  rated  the  mask  comfort  in  the  “Unacceptable”  range.  Although  the  insert 
apparendy  did  not  improve  the  comfort  of  the  mask,  as  one  pilot  put  it,  “ Flying  a  high  performance 
jet  is  not  a  comfortable  thing  to  do.  ” 

4.4.5  Subobjective  2.1:  Insert  Ease-of-Use 

A  subobjective  of  comfort  is  ease-of-use.  While  ease-of-use  may  not  directly  affect  mask  seal  or 
comfort,  it  can  affect  whether  the  insert  will  be  used  in  the  field.  The  responses  are  shown  in  Figure  4- 
13  in  which  83.3  percent  of  the  pilots  rated  the  overall  use  of  the  mask  insert  in  the  “Acceptable”  range. 


5.  Rate  the  overall  USE  of  the  mask  the  insert: 


Figure  4-13.  The  overall  USE  of  the  insert  referred  to  its  “ease-of-use.”  The 
actual  installation  of  the  inserts  was  done  by  life  support  personnel. 


Pilots  who  responded  in  the  unacceptable  range  were  also  given  the  opportunity  to  respond  using  a  check 
list  of  potential  problem  areas  and  using  comments.  The  check  list  responses  are  shown  in  Table  4-6. 

The  comments  provided  included  the  following: 

•  N/A  done  by  life  support. 

•  Did  not  remove  the  insert  at  any  time,  left  that 
up  to  life  support. 

•  Ripped  face  form  during flight. 


Insert  Ease-of-Use  Summary.  Most  pilots  reported 
the  insert  ease-of-use  to  be  in  the  “Acceptable”  range 
(83 .3  percent) .  This  did  not  seem  to  be  a  large  issue  and 
resulted  in  few  problems  reported  or  comments  noted.  However,  it  should  be  noted  that  the  pilots  did 
not  have  to  install  or  remove  the  inserts  (unless  they  removed  it  by  choice  in-flight).  Interviews  with  life 
support  personnel  revealed  they  had  no  difficulties  with  the  use  of  the  insert. 


Table  4-6.  Problem  areas  for  mask  insert 
use  question. _ 


Problem  Area 

Responses  | 

Installation  is  difficult 

0 

Removal  is  difficult 

0 

Impacts  pre-flighting  of 

1 

mask 

Does  not  stay  secure 

0 

while  mask  is  handing 
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4.4.6  Additional  Questions 

Three  questions  were  included  by  the  evaluator  for  hypotheses  testing.  The  questions,  numbered  6, 
7,  and  8  on  the  questionnaire,  were: 

6.  Did  the  insert  IMPROVE  THE  SEAL  of  your  mask  (Y/N)? 

7 .  Did  the  insert  IMPROVE  THE  COMFORT  of  your  mask  (Y/N)? 

8.  Would  you  continue  to  USE  THE  MASK  INSERT  (Y/N)? 

Responses  to  question  6,  seal  improvement,  were  evenly  divided  (50  percent  “Yes”  and  50  percent 
“No”)  as  shown  in  Figure  4-14.  Responses  to  question  7,  improved  comfort,  were  overwhelmingly 
negative  (15.7  percent  “Yes”  and  84.2  percent  “No”),  as  shown  in  Figure  4-15.  The  final  question 
addressed  pilot  willingness  to  continue  using  the  mask  insert.  The  responses  are  shown  in  Figure  4-16. 
In  the  figure,  note  that  all  five  pilots  reporting  seal  problems  with  the  original  mask  responded  that  they 
would  continue  to  use  the  mask  insert. 


Figure  4- 14.  Pilots  were  evenly  divided  on  the  question  of  improved  seal  with  the  mask 
insert.  The  insert  improved  the  seal  for  all  pilots  who  had  a  seal  problem.  Four  pilots  without 
a  previous  seal  problem  responded  that  the  insert  improved  the  seal  of  their  mask. 


A  minimum  sample  size  of  20  was  required  for  hypothesis  testing.  Although  that  minimum  size  was 
not  achieved,  additional  information  can  be  gleaned  from  the  responses.  For  example,  Figure  4-17 
shows  pilot  responses  to  question  6,  seal  improvement,  and  question  8,  continued  use.  In  the  figure, 
note  that  all  pilots  indicating  that  the  mask  did  not  improve  the  seal  also  indicated  they  were  not  willing 
to  wear  the  mask  with  the  insert  again.  A  similar  comparison  of  comfort  improvement  and  continued  use 
is  shown  in  Figure  4-18.  It  is  interesting  to  note  that  four  of  the  seven  pilots  willing  to  use  the  mask  again 
also  found  the  mask  with  insert  did  not  improve  the  comfort. 
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7.  Did  the  insert  IMPROVE  THE  COMFORT  of  your  mask? 


■  Without  Previous 
Comfort  Problems 
B  With  Previous 
^  Comfort  Problems 


Yes  No 

•;t  A'/..'--- •  Response 

Figure  4-15.  None  of  the  pilots  who  reported  comfort  problems  with  the  original  mask 
got  improvement  with  the  insert.  However,  three  pilots  who  were  not  known  to  have 
comfort  problems  reported  an  improvement  in  comfort  with  the  insert. 


8.  Would  you  continue  to  USE  THE  MASK  INSERT? 


12 


10  -I 


■8  A 


6  4 


4  J 


Yes 


Response 


No 


■  With  Previous  Seal  Problems 

■  Without  Previous  Seal  Problems 

■  All 


□  With  Previous  Comfort  Problems 
P  Without  Previous  Comfort  Problems 


Figure  4-16.  Most  pilots  would  not  choose  to  continue  to  use  the  mask  insert.  Of  those 
with  previous  seal  problems,  all  five  would  continue  to  use  the  insert.  Only  one  pilot 
with  previous  comfort  problems  would  continue  to  use  the  insert. 
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Figure  4-17.  Comparison  of  seal  improvement  and  continued  use  responses. 


Figure  4-18.  Comparison  of  comfort  improvement  and  continued  use  responses. 
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5.0  Discussion  _ 


AFOTEC/TA  was  asked  by  ALCFT  to  plan  and  conduct  an  evaluation  of  a  prototype  mask 
insert  designed  to  enhance  the  comfort  and  seal  performance  of  the  MBU-20/P  silicone 
rubber  face  piece  for  the  oxygen  mask.  The  field  evaluation  was  conducted  using  ANG 
pilots  assigned  to  the  following  Fighter  Wings: 

•  KMand  AFB,  New  Mexico  ANG,  1 50th  Fighter  Wing 

•  Fort  Smith,  Arkansas,  Arkansas  ANG,  1 88th  Fighter  Wing 
•  Buckley  Field,  Colorado,  140th  Fighter  Wing 
•  Montgomery,  Alabama  ANG,  187th  Fighter  Wing 
•  United  Kingdom  Air  National  Guard. 

This  evaluation  addressed  the  operational  use  of  an  aircrew  oxygen  mask  insert  in  which  the  seal 
and  comfort  of  the  mask  with  the  insert  were  evaluated.  The  primary  issues/factors  thought  to  directly 
affect  mask  seal  were  G-loading  (positive  and  negative),  altitude,  and  the  ability  to  perform  a  valsalva 
maneuver. 

The  original  sampling  goal  was  to  have  57  pilots  that  have  problems  with  the  MBU-20/P  oxygen 
mask  participate  in  the  evaluation.  A  minimum  acceptance  rate  of  30  percent  with  a  confidence  level  of 
95  percent,  and  10  percent  error  rate  would  have  required  23  of  the  57  participants  rate  the  mask  insert 
as  improving  performance  and  comfort. 

There  was  a  general  reluc¬ 
tance  on  the  part  of  the  pilot 
population  to  state  they  were 
having  a  problem  with  the  MBU- 
20/P  oxygen  mask  and  alter  their 
current  mask.  One  of  the  reasons 
for  this  reluctance  was  the 
requirement  to  fit  the  mask  with 
an  insert  and  perform  a  pressure 
test.  Another  reason  for  the  poor 
participation  was  the  lack  of 
support  from  the  command 
structure  of  the  participating 
units.  As  a  result,  only  18  pilots 
participated  in  the  evaluation. 

While  the  number  of  participants 
was  low,  the  data  gathered  is  still 
useful  to  the  AAOM  program. 

Most  of  the  pilots  indicated  that  the  seal  of  the  mask  with  the  insert  was  improved  at  the  cost  of 
comfort.  However,  as  one  pilot  stated,  “Flying  a  high  performance  jet  is  not  a  comfortable  thing  to  do.” 


Buckley  ANG  pilot  volunteer  preparing  to  evaluate  insert. 
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Most  pilots  also  indicated  that  the  mask  insert  was  both  restrictive  and  an  irritant.  This  was  espe¬ 
cially  true  around  the  nose  and  chin,  where  the  rigidity  of  the  mask  caused  it  to  rub.  The  foam  insert 
material,  while  appearing  soft,  feels  rough  to  the  user  when  inserted  in  the  mask.  The  roughness  is  more 
apparent  when  the  mask  is  under  pressure,  because  the  expansion  of  the  mask  exposes  the  insert 
material.  The  “roughness”  may  be  due  to  the  edge  of  the  face  piece  seal  being  pressed  against  the  face 
by  the  insert.  This  would  create  a  sharp  edge  of  silicone  rubber  pressing  against  the  skin. 

Pilots  also  indicated  reservations  concerning  the  long-term  durability  of  the  insert  material  and 
hygiene  issues  relating  to  the  porous  insert  material  absorbing  sweat  and  moisture. 

There  were  five  pilots  that  indicated  they  have  problems  with  the  MBU-20/P  oxygen  mask.  All 
five  pilots  indicated  the  insert  improved  the  seal  and  they  would  chose  to  wear  the  mask  in  the  future. 
However,  even  these  were  split  on  the  issue  of  improved  comfort. 

It  should  be  noted,  many  of  the  pilots  thought  the  present  MBU-20/P  oxygen  mask  was  not  com¬ 
fortable  with  or  without  the  insert.  As  one  pilot  stated,  “For  a  solution  to  the  comfort  of  the  mask, 
the  mask  itself  needs  to  be  redesigned.” 

While  there  was  not  sufficient  pilot  participation  to  generate  statistically  significant  conclusions,  the 
following  observations  are  offered: 

•  The  insert  appears  to  improve  the  seal  of  the  MBU-20/P  oxygen  mask. 

•  The  MBU-20/P  oxygen  mask  is  uncomfortable  and  for  many  pilots,  the  insert  makes  the  mask 
more  uncomfortable. 

•  Under  pressure,  the  insert  material  is  exposed  to  the  pilot’s  face  and: 

-  Feels  rough 

-  Rubs  against  the  bridge  of  the  nose 

-  Rubs  against  the  bottom  lip  area 

-  Creates  a  sharp  edge  of  silicon  rubber  pressing  against  the  skin 

•  Units  were  solicited  on  a  voluntary  basis,  and  some  were  not  willing  to  participate. 

-  Participation  needs  to  be  obtained  from  a  level  above  the  fife  support  (in  the  command 
structure)  to  ensure  having  adequate  numbers  of  participants. 

•  Two  pilots  were  grateful  for  the  insert  as  it  improved  the  seal  so  much  they  wanted  to  keep  and 
continue  to  use  the  prototype  insert  used  for  the  evaluation. 

•  More  testing  is  needed  to  make  a  statistical  determination  regarding  the  benefits  of  the  mask 
insert. 
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Your  responses  to  this  questionnaire  are  very  important  in  helping  to  evaluate  the 
performance  and  comfort  of  the  mask.  These  questions  will  help  the  evaluation  team 
understand  the  problems  you  may  be  experiencing  with  your  mask  and  to  analyze  evaluation 
results  appropriately.  Your  name  and  individual  answers  will  be  kept  strictly  confidential. 

For  each  question: 

1 .  Circle  or  check  the  appropriate  rating 

2.  Use  the  comment  area  to  explain  UNACCEPTABLE  ratings  (1,2,3)  and/or  provide 
additional  comments. 


Rating  Scale  and  Definitions 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Completely  Acceptable  -  The  insert  is  fine  the  way  it  is;  no  improvement 
required. 

Mostly  Acceptable  -  The  insert  meets  its  intended  purpose;  it  could  be 
improved  to  make  it  easier  or  more  efficient. 

Somewhat  Acceptable  -  The  insert  meets  its  intended  purpose  with  some 
reservations.  Meets  minimum  requirements  to  accomplish  mission/task. 

Somewhat  Unacceptable  -  Minor  problems  encountered  with  the  insert.  Task 
accomplished  with  some  difficulty.  Some  degradation  of  mission/task 
accomplishment  or  accuracy. 

Mostly  Unacceptable  -  Major  problems  encountered  with  the  insert.  Task 
accomplished  with  great  difficulty  or  accomplished  poorly.  Significant 
degradation  of  mission/task  accomplishment  or  accuracy. 

Completely  Unacceptable  -  The  insert  is  unusable  or  unsafe.  Mission/task  not 
accomplished  due  to  equipment  deficiencies  or  procedural  limitations. 
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Mask  Size: 

Insert  ID: 

Last  Name: 

Last  four  diaits  of  SSN: 

Gender: 

Location  (Circle  one):  KAFB  HAFB 

Rank: 

Time  in  Rank: 

Total  Flvina  hours: 

Hours  Flvina  F-16: 

1.  Rate  the  SEAL  provided  by  your  mask  WITHOUT  the  insert: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

2.  Rate  the  COMFORT  of  your  mask  WITHOUT  the  insert: 
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POST-EVALUATION  QUESTIONNAIRE 

Human  Factors  Questionnaire 
Instructions 

Your  responses  to  this  questionnaire  are  very  important  in  helping  to  evaluate  the 
performance  and  comfort  of  the  mask  insert.  Your  answers  will  help  identify  improvements  and 
your  name  and  individual  answers  will  be  kept  strictly  confidential. 

For  each  question: 

1 .  Select  the  appropriate  rating 

2.  If  you  experience  a  problem,  select  all  problem  areas  that  apply 

3.  Any  time  you  select  a  Completely  Unacceptable,  Mostly  Unacceptable,  or  Somewhat 
Unacceptable,  you  MUST  select  at  least  one  problem  area.  You  may  select  as  many  as 
you  like. 

4.  Use  the  comment  area  to  explain  problem  areas,  add  other  problem  areas  and/or  provide 
additional  comments. 


Rating  Scale  and  Definitions 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Completely  Acceptable  -  The  insert  is  fine  the  way  it  is;  no  improvement  required. 

Mostly  Acceptable  -  The  insert  meets  its  intended  purpose;  it  could  be  improved  to  make  it 
easier  or  more  efficient. 

Somewhat  Acceptable  -  The  insert  meets  its  intended  purpose  with  some  reservations. 
Meets  minimum  requirements  to  accomplish  mission/task. 

Somewhat  Unacceptable  -  Minor  problems  encountered  with  the  insert.  Task 
accomplished  with  some  difficulty.  Some  degradation  of  mission/task  accomplishment  or 
accuracy. 

Mostly  Unacceptable  -  Major  problems  encountered  with  the  insert.  Task  accomplished 
with  great  difficulty  or  accomplished  poorly.  Significant  degradation  of  mission/task 
accomplishment  or  accuracy. 

Completely  Unacceptable  -  The  insert  is  unusable  or  unsafe.  Mission/task  not 
accomplished  due  to  equipment  deficiencies  or  procedural  limitations. 
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Last  four  digits  of  SSN: 


Number  of  sorties  flown 
with  mask  insert: _ 


1 .  Rate  the  SEAL  provided  by  your  mask  WITH  the  insert: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas: 

_ Leaks  at  high  Gs 

_ Leaks  at  negative  Gs 

_ Leaks  at  high  altitudes 

_ Leaks  at  low  altitudes 

_ Leaks  all  the  time 

_ Interferes  with  effective  valsalva  maneuver 

_ Other  (specify,  in  comment  area) 


Comment: 
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2.  Rate  the  COMFORT  of  your  mask  WITH  the  insert: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas: 

_ Has  to  be  tightened  to  a  point  that  is  uncomfortable 

_ Interferes  with  eyeglasses 

_ Causes  irritation 

_ Causes  the  mask  to  sag 

_ Uncomfortable  at  higher  altitudes 

_ Uncomfortable  at  high  Gs 

_ Uncomfortable  at  negative  Gs 

_ Uncomfortable  during  combat  maneuvers 

_ Uncomfortable  for  lengthy  use  (specify  approximate  length) 

_ Uncomfortable  at  all  times 

_ Other  (specify,  in  comment  area) 


3.  Rate  the  COMPATIBILITY  of  the  MASK  INSERT  with  existing  equipment: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas: 

_ Interferes  with  vision 

Interferes  with  microphone  use 

_ Interferes  with  mask  release 

_ Interferes  with  visor 

_ Adversely  affects  pressure  breathing 

_ Adversely  affects  regulator  flow 

_ Other  (specify,  in  comment  area) 


Comment: 
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4.  Rate  the  performance  of  the  MASK  INSERT  MATERIAL  (please  explain  any  effects  in 
the  comment  area). 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas: 

_ Affected  by  heat 

_ Affected  by  cold 

_ Affected  by  humidity 

_ Affected  by  oxygen 

_ Affected  by  skin  contact 

_ Deteriorated  over  time 

_ Other  (specify,  in  comment  area) 


5.  Rate  the  overall  USE  of  the  MASK  INSERT: 


1 

2 

3 

4 

5 

6 

Completely 

Mostly 

Somewhat 

Somewhat 

Mostly 

Completely 

Acceptable 

Acceptable 

Acceptable 

Unacceptable 

Unacceptable 

Unacceptable 

Problem  Areas. 

_ Installation  is  difficult 

_ Removal  is  difficult 

_ Impacts  pre-flighting  of  mask 

_ Does  not  stay  secure  while  mask  is  hanging 

_ Other  (specify,  in  comment  area) 


6.  Did  the  insert  IMPROVE  THE  SEAL  of  your  mask  (Circle  one)? 

Yes  No 
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7.  Did  the  insert  IMPROVE  THE  COMFORT  of  your  mask  (Circle  one)? 

Yes  No 


8.  Would  you  continue  to  USE  THE  MASK  INSERT  (Circle  one)? 

Yes  No 


9.  If  there  is  some  aspect  of  the  mask  insert  that  has  not  been  covered  by  the  previous 
questions,  provide  additional  comments  in  the  following  comment  area. 
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As  stated  in  the  body  of  the  document,  the  following  assumptions  were  used  to  derive 
the  required  sample  size: 

1.  The  F-16  pilot  population  is  roughly  1,300. 

2.  Forty  percent  of  F- 1 6  pilots  have  problems  with  their  mask  ( 1 300  x  0.40  =  520). 

3.  The  mask  insert  must  improve  performance  and  comfort  for  at  least  75  percent  of  those 
with  problems  (520  x  0.75  =  390). 

4.  Therefore,  the  minimum  acceptance  rate  is  30  percent  (390/1300). 

5.  A  confidence  level  of  95  percent,  with  a  10  percent  error  rate  is  required. 

6.  A  one-tailed  test  of  significance  is  appropriate. 

The  required  sample  size  ( n )  was  derived  using  the  following  formula  for  a  binomial 
distribution  (the  binary  response  being  Acceptance/Rejection): 


n  =  [z  ( a/2)2*p*q]/E2 

Where: 

z  =  Criterion  statistic  for  the  one-tailed  confidence  interval,  z(95  percent)  =  1 .64 
E  =  Error  rate.  E  =  10 
p  =  acceptance  rate,  p  =  .30 
q  =  1-p  or  the  rejection  rate,  q  =  .70 

Solving  for  n  we  get  56.99.  Thus,  a  sample  size  of  57  should  be  sufficient  to  confirm  the 
null  hypothesis  that  the  insert  improves  mask  seal/comfort.  However,  after  data  have  been 
collected,  z  can  be  computed  for  the  observed  acceptance  rate.  The  ratio  of  observed  acceptance 
to  total  observations  plays  a  critical  role  in  computing  the  z  statistic.  Therefore,  by  computing 
this  value  on  an  on-going  basis,  we  can  reduce  the  required  sample  size  if  the  resulting  ratio  is 
large.  We  use  the  following  formula  to  compute  z: 

Z  =  (pl-p)/^pq/n 

Where: 

n  =  Number  of  observations 
x  =  Number  of  acceptances 
pi  =  x  /n 

p  =  minimum  acceptance  rate,  p  =  .30 
q  =  1-p,  q  =  .70 

Using  this  formula,  we  derive  a  value  for  z  that  is  compared  to  the  criterion  statistic,  z(95 
percent)  =  1.64.  If  the  derived  value  is  equal  to  or  greater  than  the  criterion  value  then  we  can 
accept  the  null  hypothesis  that  the  insert  will  improve  mask  seal/comfort  for  at  least  30  percent 
of  F-16  pilots.  Table  B-l  illustrates  values  of  z  based  on  number  of  observations  (n)  and 
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acceptance  rate  (pi).  As  shown  in  the  table,  if  50  percent  of  20  (or  greater)  pilots  find  that  the 
mask  improves  seal/comfort,  there  is  a  sufficient  sample  size  to  meet  the  confidence  level  and 
error  rate  requirements. 

Table  B-l.  Values  of  z  based  on  number  of  observations  (n)  and  acceptance  rate 


n 

10 

percent 

20 

percent 

Acceptance  Rate 
30  40 

percent  percent 

50 

^percent 

60 

percent 

20 

-1.95 

-0.98 

0.00 

0.98 

1.95 

2.93 

30 

-2.39 

-1.20 

0.00 

1.20 

2.39 

3.59 

40 

-2.76 

-1.38 

0.00 

1.38 

2.76 

4.14 

50 

-3.09 

-1.54 

0.00 

1.54 

3.09 

4.63 

57 

-3.28 

-1.56 

6.00 

1.75 

3.37 

4.98 
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AAOM 

Advanced  Aircrew  Oxygen  Mask 

AFB 

Air  Force  Base 

AFOTEC/TA 

Air  Force  Operational  Test  and  Evaluation  Center,  Rapid  Test  and 
Assessment  Directorate 

ALCFT 

Armstrong  Laboratory  Crew  Technology  Division 

ANG 

Air  National  Guard 

DESA 

Defense  Evaluation  Support  Activity 

G-forces 

gravity  forces 

LAV 

large/wide 

M/N 

medium/narrow 

MAV 

medium/wide 

S/N 

small/narrow 

SME 

subject  matter  expert 

SSN 

Social  Security  number 

UKANG 

United  Kingdom  Air  National  Guard 
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